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ABSTRACT ^ 

- - - --^--i — j^achr-r ^valuatioti procedures app^aT tc focus on - 

orqanizatidnal maintenance asp-5Cts mQ^4 heavily than on .helping 
taachara improve th^ir. tftachinq pi^rforiftariGB. This conclusion was 
reached after a content analysis of teacher avaluation instruments 
usad in New Mexico schOQls,. It?m3 focusing on the instructional role 
constituted only 2t% of th? it^ais in tht ranting scalii instruii^^nts* 
Other factors used in t'sacher evaluations included personal , 
characteristics (30*); adaiinistrator/managar role/{1M*) ; social role 
(12») ; professional roln (7%) ; organizational Qiembarship rola {!%) % 
and student achievement (l^j^^Th^ results also suggested that 
orqaniiat ional consarvatisni and stability, rather than change^, appear 
to be highly Walued,^ From a supplam^^nt ir y analysis of t^?acher 
avaluation instruments datlnq from th^^ turn of the centruy to the 
prasent, it was concluded tha^ th^ secondary ©mphasis on ^ 
instrucjtional role has b-^^n a p^rsi st^ nt cha ractaristic of taacher 
evalua^tion over th^s y^-ars. (^IV) 
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the time — such 4s the Jtf agl-cpinady of Our 's1tuat1onr* 
Inge to clat[fttU!ofc^ha&eiyeiiy-.quaJJ.t4fs^ 
-Imposslblt. You can hardly'opert,-a periodical without coming^ . . v w 
V across the/statement that what-our civilization- needs Is more>^^ '' 
f 'dHve,' or dynamism, or self-sacrifice, or ^creativity. ' In , 
sort of ghastly simplicity we/^anoitt t^^^^^^^^ 

• . , the function. . We castrate and bld.the qeld'lngs be frUltfliT,' 

" ' ' ■ .' 1 ■ ■ ■ ,• ■ ' , ■ -\ . ■ ' ■ ■ ■ ' ■ ■' I- ' . 

' -- G. S. Lewis tl947vP- 35) - • ■ v — 

RecantTy the Educatlgnal Resaarch Strvice {1978) pubtU ^ 

% ■ ' ^ / " • " ' 1'' ^ ' ^ - , ■ . " ' 

results of a survty conducted to ascartain the fcurrarit,practi^as of ^ ^ 
evaluating taachar pe'^ornianca 1n school, systeins throughout thie Uhltt^ 
states. One section of the report described "the uses^madt of the 
sumrnativa evaluation reports" (pJ79)i^ ^^ased on^ the re^orises from 363 ■ 
school distrietSs ERjS listed l^^four most frequently' mentioned purposes 
of teacher evaTuat ion %si 1) to help teachers improve their teaching 
performance (349 responses)^ 2) to decide on renewed appointment of 
probationary teachers (328 responses) i ^ 3) ,to recormiend probationary - ^ 
teachers for tenure or continuing 'contract status (326 responses); and 

4) to recorpend/dismlssal yOf unsatisfactory tenured or' continuing fcontract 

. ' / ' ^ ' . ^ ^ " ■ ^ ^ ^ ' . 

teachers (317 Responses), We suggest that the most frequently listed / " 



purpose, i.e. I helping teachers Improve their teaching perfor^&ncei is . 
fjlindamentally different from the otHer three and* more Importa^ily, that 
this purpose is not clear*! y operational ized 1n the evaluat'Wh processes 
currently used 1n many schooV districts. Our "stance is derived from the 
reality of the teacher evaluation processes which focus much more heavily 
on ofganizational maintenance than they do on Improving teacher classroom 
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perfbrmanM.' ^Our justl'^icatlon for this stance js der.lved from an' ^' 

sejan}4ft04^n-c^t€|ich& p cval ^-lon-tnst^r^^ 1r(..terins-.;9 . f HJI . 

content jUms on which teachers are assessed and- on the , procedural and' . >. . 

strudtural properties of the instruments. Following a report of these ■ ' 

findings, via will discuss one factor which helps to^-ex^laln why teachef 
■ . ) ' . ^ ' ''' 

evaluatibn processes tend to eniphasize organizational malnte 

rathar than Improved teaching performance . 

' Nature of fnstrurhertts Used in the Evaluation Process 

Content Characteristics" of the Rating Scale Instruments 

: The major reskrch,%^M^s an analysts of the teacher evaluatldn ;. 
Instruments currently used in New Mexico schools. Instruments were 
solicited from all 88 districts.. ' Of the 71 dlstrltts respondfn^ , 6r , 
submitted ratirTg scales and 6 submitted o^pen ended instirument^. Data from 
the former only wil l be. reported in this section of the study. : ' 
' An early dec1 sion was to ' engage in a coatent analysi s (Hoi sti , 1 968) . 
of the instruments. Consequently we first scanned a ttumber of the more 
complex instrijments In' order ^. to provisionally identify a set of; categories 
and declsibn rules. One oytcome\f this process was the observatloij tjpat 
the items fn the. rating scale Instrumihts focused more heavil-y on tlie- 
teachers than upon teaching . Reflected in the Items was what appeared to 
be a major concern for the teacher' as a 'person, a Professional |n • / 
: adnjinlstrator/manager, and a member of. the schwl organization. Hence 
deyised a ^tentative catfgory system based uRon^ roles and role performance, 
Seqondj'the adfquicy of- this category system ^nd attendant decisiorv rules 




functions 



was tistid by conf 



instruments. ; In t 



tmtrged In^age tt*o. Tha.iftsu>^ of the analysis of the 65 rating Scale 




ng rimdom saiipple of ten addltloha-l 

nece'ssafy^ef tnenientS'^HHHtP*'^ • ^^'^ p ' ^® re-an^Tyzejl al l ' of the | 
data on feKe basis of |SeiBKset of categories and decision rules which/ 



Instruments are displayed A'Figure 1 
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Insert Figure T^afciout here 



Given t^a' man1f4sjf purpose 0^^^^ evaluation, one might have 

predicted, t^at the I'nstiructlonal rp^jategory would account for the 
majorlt^of Itenfs' on^^he evaluation ffirSs, However the Items 1n thls^ 
category (e^g. i ;"lidequati preparation of lesson plans"; "has work Ireas 
arranged for maximum pupil $t1mulat1on and accomplishments"; "challenges^ 
students think. Inquire and analyze"; "used varied techniques In 
evalflatlon of student progress") accdOnted foT^'only 28, 22?^ of the itims 
In the i^ating^scale Instruments. Personal characteristics of the,teiicher 
(e.g.; "enthusiastic", '^nse of humor", "considerate", "^ctuaV'O 
actually accounted for a higher percentage of Items (30,031). However, 
as Table 1 suggests, all of the rating scale 'instruments contained at 

■ i ' ■■ ' ' • ? _ - 

- . ^ - 2 ' ■ 

least one ittm related' to the instructional role category. i 



Insert Table T about here 



r 



. . ■ I 



p. 



' V ■ • •■>-;,■■■■■ , 




Student 
Outcomes 



Organizational 
Membership Role 



Professional 
Role 



Spclal Role 



ERIC 



f 



J 



Figure 1: Distribution by ^category of fttmS In 
'**rat1ng scale Instruiftents 
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♦Percentages based on = 19i6 iterts 
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Frequenciii and^ercthtages of Itgms by Cate g ory 



TabTi 1 




In tha -Rating S^ale irtStruments* 



~~' . ^ ^ Number of % of 

Evaluation Districts Districts 

Inptfument Categories Reportlnl Reporting* 



' Nwnbfir 

of,^ 
Items 
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Instruct londlv Rol es 

Pefspnal . 
^hai^acterl sties 



Social Roles 

Admin 1st A 
Roles . 



anager 



Organizational 
Membership' Roles 

Professional 'Roles 
Student Outcotfiis 
Other ** 

Total 



65 

62 

61^ 

7 

55 

54 
15 
7 



100.00 
95.38 

93.85 H, 
90.77 

;84.62.'" 

83.08 . 
23.08 • 
10.77' ■ 



I 



if* 



Pefce'ntages based on N = 65 districts 
^ercentagfii based on fl^= l,928.1tips 



J. 



'I 




r 



1 ,928' 



100.00 



v.: 



. In addition to focusing m^h% tepfiher rather t^^n on the leaching* 

and pass-Judgmant ^the teacher's entire w^rk world\ Items pertaining 
^'to.the taach^'s admlnlstratbr/inahlger rolSp soctal role, profisslbnal 
. r^le, and organizational membership r^l a collect Ively accpunted ftr - 



of teach Ing.' ,A ^rref 



St" 40%^, the total numben of items on the'rating scale Instruments,. 

• 1" ■ " ■ . ' , >, / 

• Though the teaeher's performahv of these role^ay be thought necessary, 
to the smooth 'Operation of the' school organizattoh, these rt.lfs are 

^i^'ssentially lupportivX' to the primary role 
j, descriptibn^f (the types^of items 'included under each .■of these four role 
categortie* follows. / ' ^ 

F1rst ralmo5t 14% ofvth4 items focused on whatSveichose to' U&el the 
Heacher's admin istraior/manager retfr. Items placed t/^this categbry » 
.evaluated teachers on'^f^'r ability: 1) tb control students^ e.g. i "Is 
a^l^to maintain discipl IneS. 2).^|o atte'nd fo thj^physical*, housekeeping _ 
, and -aesthetic qualltlei of the . classroom environment, e.g., "keep| room 
neat, attractive,^ ^rid in^rde^"/, and 3) to pej«form admirt1strative ■duties, « 
e.g.^ "keeps records accurately" 'and "fial Is for substitute on time". / ,^ 
[ . Second, the\social role' teachers "were expected fto perform In the 
stfhool organlzaoon was the focus df ilrribst i% of the iT^ms in the rating 
'€cale "instruments. By social roT'e w^ refer to the teacher's, I'nterpeHonal 

• riT-atiQnship% both" within and without wie.sctiooT ?1te. , Sinty-one school 
disjtrifitt (93^5f) tncludid one or more items which rejerred, to the . 
teacher's relatfonship with! ll 'the communltift e.g., "^ffimWrshlp in 
community groups"; 2) other school staff, -e.g., "treats nonTcertified 



stiff wfth respect and indars^ndihg^^^ stud^ntSs e.g. sj/"teachalr- ; . 
puptl Tilationship"; and 4) ydiitrlct. ^rsonnefr e,g, , "works cooper^-^'. 
attvely with other schpol or district personner'^ : ' \ 

Third* 54 dlst^rlcts {B3.M%) included Jn thlir teacher evaluation 
tnstwjments at least one 1tfm wM^h asse som^aspect of the teacher s 
professional role. By profess ranav'role we refer *to those ^^^^^ 
^isoclated w1thj* ;l) the teaehe^;s a^cadt^ic preparatfqh and irnastery .of * . . 
%hp siAdij^c^rnatter contents ^e,g^, * "knows subject matter and^ books being 
used"^ 3) the teacher's ccmmitment to» professional growth^and developrrient, " 
e.g. -I llinterest in self-impravimint"; and 3) iten^ which judged the ethical 
standards of the teachej^, ■e.g. ."^ "adheres to acd^pted'j?ethiCa->'-and social 
standards of the t^nniunity and the profess^oh". The itgms .1n the profes- 
sionaT role category constituted ^J7% of the itei^is in the rating sca|e 
instruments. f ^ - ^ ^ - 

Finally, the 'it^ms categorwed under the teacher's brganizattonal 
membership r^le (N = 136; 7,05%)^ indicated that teachers , were expected^ to 
exhibit attitudes and behaviors in concert with^^e nee^s^ and ^oals of ^ 
the school brganliation. ItWis under this rubric assessed the degree to 



.^which therteacher 1) was yiaw-abid1n|% e,gci( "'seeks to undirst&nd anfl 
libide by alU^^choo% rules and regulations"! H pomp! led with the^ suggestions 
of other' professionals^ e.^,f ''accepts and uses''scqnstructiVe cr1tic1sm"k 
*^3) assumed ^non-teaching responslbilltfess e^g., "assumes assignments, and^ ^ 
extra duties' willingly" I afld 4) exhlb^ed and organizational perspective, 
e.g^, "seis ^1s/her responsibility in relation to the total school ^program". . 



In sum, sdhooT districts appeaftd to place a high value on whatiwe 
6oneep%uaW^td*M-&>*gafl1iat4ehal 4naT 
'of tha Itims addressed ^uch Issues as t|||t tocher 's: ablKty *to mjintain 

•t)r^er and function, efficiently^ to ggt along well ,w1wi others t tOvexh^blt 

. ^ . ^ - ^ ^ ■ ' - 

"proftesslpnaV! behaylorSi ^nd to comply with the rules o^^he organization. 

Our major point Is that while such roles and role behaviors may well be ^ 

essential for organizational mafntinapce* they are only tangential ly 

related^ to classroom teaching, ^ . ^ 

, The organlEatlonal maintenance emphasis was further accented in one^ 

of .the personal charactirlstlcs sub-cat^egorles. Through a more fine- 

grained analysis of the sub-category ."personal traits*" four groupings 

emerged: 1) . traits related to membership In. the organization^ 2) 

traits related to work with students, 3) traits related to the task of 

teachlngi and 4) traits related to the teacher as a^ person* Table 2, 

displays the ^98 Items m the evaluation Instruments referring to these 4 

grqliplngs, V - j 



Insert Table 2 about^here 
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The data frarn^TablS 2 indicate that those trflts assoclattd with 
orpilnlzatlonal membership (Grouping l') comb1ned^w1th-tHose related to 
the teacher ai a person (Grouping 4) account for 60.06l'of the personal 
traits assessed by, 'the school districts. It Is of more than casual 
interest to note, further that tliose traits more clds«1y associated with, 



iO 



Frequincy of the Inclusion of Spsc1f1ctParsonal Traits 
Relatad to drganlzattiDnal MaRibershlp,* Students, the 
Task'of, Teach^^^d the Teachef as a Person 



Personal Traits 



^..Traits Related to 
' ' Organizational 
* Membership 

Punctual /pror^t 
Cooperative 
V ^ Dependabl e 
. Accurate 
pesponsl-ble * 



Adaptlble 
Flexibli 

Total 



5er of ^ 
Times - 
Reported ' 



68 
12 
12 
11 
10 
4 
4 

_ 2 
123 



Personal Traltr 



Traits Related to 
Task of Teaching 



Enthusiastic 
Initiative 
Rasourciful . 
Leadership 
Creative , 
Original \ 
Innov|t1ve 
Dedicated 

Total V ^ 



Number of 

Times 
Reported 



43 
15 

6 

2 
1 
1- 

J4 



2. Traits Related to 
Work with Students 

Interested in 
Fair ' 
; Patient , 
Compassionate 
Positive Attitude 

Toward 
Impartial 
Con si de rite 
V Tolerant 

S^pathetic ■ • 
Constructive 
Democratic 
Empathetic 
nane 



.eous" 



Total 



22 
17 
^IV 
10 

. 7 

6 
3 
2 
' 2 
1 
1. 
1 , 
1 
1 

, 85 



Traits Related to the 
Teacher as a Person* 

■ Judgment, 
, 'Sense of Humop 
Self-controlled 
T"actf ul 
Poised 
Sincere . 

Emotionally Stable 
Honest « 
Exemplar 
Calm 

Self-confident 
Mature 
Friendly 
' Discreet 
Other* 

Total:. 



29 
,16 
11 
10 
TO 
7 
5 
4 
3 
3 
3 
2 

• . 2 
2 
9 

#116 



*Each o^the following personal traits wSs reported by one, school districts 
Alert, Perseverant, Patriotic, Open -Mtjided, Reasonable, Optimistic, Facts 
Problems Honestly, Good" Mental Health, PiDsltivie Self -Concept, ' • 



V ■ , ^ ' ■ ■ ■ s.' .;[_ ■ ^ _ " ■ - 

( • ' tht teacher's tnstructlAnaV rolfi, 1 .e. ,'i^/Ofle with students (Grouping 2) ' ' 

. " - ■ . . ' — 'i, ' "" * ■ 

and the task o'f teachlhg (Sroupjng' SK conStitute only 39.95^ of the total 

•':,*Mofe particularly, for example, refer|rttfS to>punctual1ty (N'--68) exceed . • • 

by a faptor of three riftrencas to intirest 1n students (N -22)*. / 

" The Inferences from data ITJce these are clear, Flngt, 1t appears 

that teaehar evaluation instruments reflect a primary coricern for y 

ogr&nlzatlonal maintenance and a sicondary concern for improvement of 

Instruction. The item's Jn the tnstruments concentrate heavily on outside 

of the classrffofn phertomena* Second, and related to the first, organ'izatidhal 



conservatism and stabnity rather than change appear most hrghly valued. . 
Traits such as punctuality, ^cooperatloHi dependability, responsiblity, , 
accurac^^ loyalty and adaptaynity (N =J21) reflect the former, while 
traits ^such as creativity, iBnovativaness, originality, leadership, resource- 
fulness, initiative and flexibility (N = 32) mirror the lattef* and are 
assessed much less frequently. ^ 

Jn drawing t^hesen'nferences we are not suggesting that mort items, 
should focus on ihe^-%^rc.he,r*s in-class instructlsnal roTe and fewer on ^ 
what we have identified as the 'broader organizational membership role. 
Indeed, the data gathered on current teacher evaluation instruments may be^ 
highly pertinent to the maintenance furictions of schoSl qrganiiatlons 
particularly with reference to making personnel decisions. However we 
contend equallj^ strongly that maintenance emphaslzihg data currently 
. obtained under -the broad rubric of teacher evaluation are "largely Iwelevant 
tp the manifest purpose of improving Instrufition and hence provide little 
leverage for affecting change in teaching perfortnance, . ^ 



Supplementary Analysi s' \ * , . ^ -'^^^ ^ , ' 

We combined the open ended Instrumirrts With the ratlna^cales (N;= 71J 
to accomplish an analysis , of the design-characateristics of the evaluation , 
instrunwntSs 1.'e,, thfrlr procedural requirements and structural prope^.ties. 
In tfiis supplenientary analysis^s jve found supporting evidence for the ^ ^ 
primacy of the organizatianal maintenance function of teacher evaluation 
arid, the corresponding siiybrdination of th^. improvement of instruction 
function. First, less than a third of all the documents "(23 of'7l districts; 
32,39%) indicated specific conferending requirements. Of ttiese, three (4,23%) 
required a pre-conference; 19 (26.76%) required a post-conference; and one 
(1.41%) required both. The more typical pattern was the simple requirement > 
that both the te§cher and the evaluator sign the evaluation document* gven 
Here s however, some discrepancy was njoted: evaluator signatures were 
specified requirements on 66 of the 71 documents (92.96%), while somewhat 
fewer teacher signatures were so required- (64 of 71 1 90,14%)* Furthermore, 
It might be noted that only one distfitt required conferencing with tenured 
teachers following a classroom observation. 

Second, with reference to the number of observations or classroom visits 
on which the evaluation was to be based, data from only 11 of the 71 districts 
(15.49%) suggested that more than one classroom visit was required, ; Third, 

4 

it appeared that non-tenured teachers were the primary target of observation,, 
Finally, of the 58 rating scale Instruments which 4jsed evaluative designatians 
such as "needs to Improve," ''satisfactory," and so forth, only 24 (41,38%) 
included designations more positive than "satisfactory," "acceptable,** or 
"average." 



Our major point 1s that 1f Indeed the purpose of teacher evaluation 1s to 
Improve instruction then 1t does ^t seem unreasonable that conferences, both 
pre- and post-^observatlonp should be routinely scheduled with all teachers 
observed! that rrtultlple classroom observations should be required of the 
evaluator; that all teachers, tenured and non'-tenured alike, should be ^ 
involved regularly In the process; and that scaling should be precise, fff-oad 
ranges and indicative- of a concern for excellence. These design character- 
istics were in scant evidence. Their omission communicates to teachers and 
evaluators alike more of a-concern for maintenance and meeting ^'minimum 
standards" than systematically improving instruction. 

Fact'ors ' Which Perpetuate the Organizational Maintenance 
Function of teacher Evaluation 

How does one account for the "tragi =comedy" of the situation where school 

districts profess that the primary purpose of evaluation Is to improve teachin 

performance whereas the tools and procedures through which they attempt to 

accomplish this purpose tend to communicate a manifestly different concern? 

A useful perspective is provided by Piatt (1973) and'Culbert (1974) who 

conceptualize troublesome problems in terms of "trap" comments, Piatt defines 

"social traps" in the following manner r 

Jhe term refers to situations in society that contain traps formally 
like a fish trap, where' men or organizations or whole societies get 
themselves started In some direction or some set of relationships 
that later prove to be unpleasant or lethal and that they see no easy 
way to back out of or to avoid, (p* 641) 

Culbert's notion of the "organization trap" suggests that traps take the 
form of assumptions people make about how the organization operates and 
about how they operate within the organization • "We assume that what others 
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imply ^is happening is in fact happening" (p. 12). /^phermore, ,CulbeH 
indlcatis that these assumptions "limit the extent to which we manage 
our organizational lives and subject us to excessive Influence by the 
system" (p,20), ^ ' ^ 

We posit that similar "trap" components exist 1n, teacher evaluation. 
We will approach our discussion of these traps from the perspective of 
what Lortia (1975) has labelled "the hand of history" by damonstrating 
that the evaluation instruments used in the late 1970*s reflect emphases 



s1m11ar|fo those amanating from the age of scientific management* This, 
is initially consistent with Davis' (1964) conclusion of fifteen years 
ago that "Mathods of aval uating teacher competence currently used In public 
school systems have evolved from practices of many years ago" (p. 41);^ 

^ Empirical support for this stance was obtained by examining item 
contenti procedural charactaristics , scaling patterns, and the stated 
purposes of teacher evaluatiop, instruments from the turn of the century to 
the present. Mora specifically^ a comparison was made of four Instruments ' 
drawn from three points in time: the Age of Efficiency (two Instruments) * 
the Age of Human Relations (one instrument) and the present time (one 
Instrument). Additional ly, comparative analyses ware dona on summary studie 
completed during those three time periods. The rationale for instrument 
selection follows. 

The first instrument, Elliott's "Provisional Plan for the Measure of 
Merit of Teachers," was originally developed in 1910. A later aditioni 
"not materially different from the first" (Boyca, 1915, p. 78), 
appeared as an Appendix to the 14th Yearbook of the National Society for 



^ 



m StudyW Education in 1915, Boyce further indicates that Ellfott's 
"tentative scheme for niiasurtng teaching efficiency** was ''widely used as 
a pattern" (p, 78). 

Boyce's (1915) own instrument is our second exemplar of the Age of 
Efficiency, Appearing originally in the March 1915 issues of the American 
School Board Journal , it received further endorsement in the 1915 NSSE 
Yearbook . Callahan (1962) observes that it was "warmly received . . . and 
adopted in -many school systems" (p. 105)^ while Davis (1964) notes that it 
was "so widely copied that it now appears cormionplace" (p. 47), 

The third instrument was utilized by the Oakland Public Schools in the 



1930's. feavis and Cooper (1945) identify it as one of the "examples of 



the better/ rating practices" (p. 46) since as a probationary teacher 
instrument it could be Instrumental in "protecting the school |rom the 
[permanent] appointment of unpromising^ teachers" (p. 67). final instru 
ment chosen for comparative analysis is one of the more popul fir {k =11) 
currently in use in New Mexico schools. 

In making a comparative analysis it -became necessary to AJtl 11 ze a 
common set of categories and decision rules* Consequently/^ we re-analyzed 
the Item content of the Elliott^ Boycej and Oakland instruments using the 
New Mexico format. The results are displayed in Table 3, 



Insert Table 3 about here 
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.Additionany, Boyca, Reavis and ^Cooper, and we had analyzed set-s of 
instrum^ts (Boyce, 50 rating schemes, 25 categories, 395 Items-, Reavts 
sind Cooper, 85 rating seal esi 7 categories, 1539 Itemsi Wood and Pohland, 
65 rating scales ,1(8 categories, 1928 items). Therefore, we did a comparison 
of the summarized findings,^ All-in, we applied the New Mexico category 
system and decision rules to the earlier data. The results of tills compara- 
tivi analysis are presented. In Table 4. . . . 



( . _ ; 



^ > Insert Table 4 about here ' 

The "hand ^ h^istory'' Is clearly noticeable In the. data presented 
In Tables 3 and 4. First, the importance first ascribed by ETHott to the 



asse^ent of personal characteristics has persisted and hajs in fact risen 
overai;i (Table 4). "Only, in the single Instrument analyzed^by Wood and 
Pohlahd is the percent of items assessing personal characteristics less than 
any other category (Table 3)* As expected, the primacy of assessing 
personnel characteristics reachjsd its nadir in the Age of Human Relations 
(Table 3) Its after effects jire probably what accounts for the high 
percentage figure today (Table 4)/\ 

That the importance of assessing this factor has endured over the. years 
may well be attributed to the ascribed sbcialization function of schools 
(Btdwell, 1965), the associated demand fpr ikemplary adult role models 
(Lortle, 1975), and the historic dominance of an Ariglo-Saxon value orlenta-. 
t1on. Hence the persistence of such ''personaT\characteristics" as self- 
controls promptness" reliability, initiative, and the like. \ 
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Sicond, the relative amphasli ftven to the Instructidnal^ role of 
/ i\L taic+iar {Tabli^4) ha^ ramainid ^Fa1r^y consistent, showing but a 
slight percentage decrease in thi Agft'af Human Relations and a slight 
pir^aritage Increase today* Even in Table 3 where the widest fluctuations 



^ ^octur, the varlatl'^ns within era\(Eniott vs, Boyce) are'not appreciably 
diffareni- than the vfiriatlons between eras (Reav4s and Qooper vs. Wood and 
Pohland), wFurthar j the stability of this factor is reflected in the ) 

nature';^f t+ie itams agsassed. . For axamptfts Boyca's^ (1915) "Efficiancy 

* " ■' if'- " ^ 

. Record-' rated teachers onj''Grasp of subjact-mattari" the Oakland instru- 

ment^/epDrted by Reavts and Coope^r (1945) assessed "Knowladga of Subject 

Mattar;" and the N^w Mexico instrumant most coramonly used rates taachtr^s 

on "kno^s subject' mat*%r>and. books being used." 
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The data are somewhat ^ess clear relatlvfe to the assessment of 
teacher administrative/managerial competancei Table 3 indicates a moderate 
emphasis on those aspects of the teacher's role in the 1910's, a decrea^^ 
emphasis as expected. in the 40'S| and a major percentage iincraasa in tihe 
70*s* The latter ptianomenon Is totally reasonable gi vert'' the current press 

V;. " / 

for accountability* Table 4, however, shows a marked amphasis in that 
domain during the Age of Efficiency, a phenomenon consistent with Callahan's 
(1962) analysis; an equally marked diminution in the Age of Human ftelatlohss 
and a slow trend for ra-eijiphasiz1ng that element of teacher behavior today* 
Somewhat similar ambiguities surround the assessment of the teacher's 
soclaV role. One might have .predicted that the Instruments used during 
the Age of Human Relations would tend to have exaggerated the teacher "^s 
social role. Table 4 indicates that during, the Age of Human Relations 
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theVfe we^ a rather pronounced rise in the nuhS^ of items related to the /' , 
-tQ^lal role when compared with/,the number for the Age of Efficiency and 
*^^tft|i' suggests a modarate emphasis in present day instruments. That this- 
^m'9m%S^ fs noWeflee|6d, in Table 3-is somewhat puzzling. In Table 3 
^the comparison of IVidivldual wting scale instrufnenta during the th^ee time 

• _ _ ' \ w \ ' ■ • ' - 

periods yields virtiia.1-l7,^o: differences in the percentage of items related 



to the teacher's social, r^e. Here as elsewhere, however, 'the explanation 
may weJV reside 1n the ch^'ce^of Ihstramen^* In that sense Table. 4 data 



present a more accurate picture of overall trends. 

One of the more Interesting comparisons Is relative to the data. on the 
assessment of the professional role. When one looks at the end points of 
Tables 3 and 4 the trend is clear -- less attention to that role. This may 
w#ll support Culbert's (1974) point that school people make an assumption^ • 
about what is happening within the organization and act as if it were indeed 
happening. The assumption In this case Is that the Increased 'profession- 
allzatlon/tralning of^teachers (Blood, 1978) results In 1ncreased;^rof Iclency 
and consequently one need pay less-attentlon t^the professlonayrole Issue.. 
Theije 1s, however, a m1d-point anomaly which should be pointed out. Table 3 
Indicates an Increase In attention to this variable during the Age of Human 
[Relations when compared with the Age of Efficiency while Table 4 shows the 
reverse. Several observations can be made. One, the variation between the 
two sets of Age of Human Relations data is slight (13,33 vs, 12.09), , 
Second, the difference may again be. artifactual (one instrument vs. 8fe)i 
third, and more intrigulngly, it may reflect the tensions in the role of 
principal as evaluator which arose during the 1940-s, On the one hahd 
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.principals were ut*ged to ra-^def1ne themselves as instructional leaders 
/while on the other hand they wer^ exhorted to maintain their adminis- 
trative orientation. Cfur #ata fnom this study, are insufficlenf to resolv^ ^ 
this Issue here. ^ 

The final two categories , Organizational Membership Role and. Student 
Outcomes i^^ovide clear cut^rend data. The or§an1zational membenship 
role of the teacher received moderate assessment emphasis during the Age 
of Efficiency* weak emphasis in the Age of Human Relations 5^ and is currently 
, .undergoing a resurgence, although" not to the degree of prominence It enjoyed 
during the Age of .EffiQiency (tables 3 and 4). Student outcome data ^s 
never been serio^rly used as a measure of teaching competence* It was a 
minor fafctor in the Age of Efficiency, rose moderately during the Age of 
Human Relations, and all but disappears In thes sample 1970's, 
Instrument (Table 3^^ At the least, one can conclude. from this that thrusts 
for accountability and/or "competency based teaching" have not bfen echold 
In evaluation practices. 

In sum, relative t6 the content of teacher evaluation instruments ,^ the 
"hand of history" appears very heavy-handed indeed. Variables upon which 

teachers are evaluated appear to be largely constant over time, with but 

- 1# 

minor variations a(nd fluctuatlonsMn emphases. In the main, the conceptiop 
of tea^e^ corhpetence established at the turn of the century remains Intact. 

Much the same observation can be made relative to certain procedural 
characteristics. For example, w^en we asked, "Who does the evaluating?" 
the historical pattern persisted. Boyce (1915) reports that "rating the 



teachers 1^ done in one way or anothir^by' the principals or superintendents 
or both" (p, 15h Reavis and Qooper (1945) note that 89,3% of the raters 
wfTO principals, supervisor!, or ^'administrative and superyjsory staff" 
(p. 39),^ Davit (1964) states bluntly that "the principal is the primary ^ 
rating officer" (p. 37), New Mexico data confirms that condition^ State 
statutes require principsls to engage in teacher evaluations for the - . 
purpose of making peirsonnel r^ectfrmendations to the superintendent* In brief, 
administrative practice begun in the early 20th century have been Tegitimatid 
by law. 

The method of rating teachers, has also changed but little. Rati^ng 
scales were prevalent in Boyce's day and clearly advocated by him. Reavis 
and Cooper reported that in one study of 104 school districts all but one 
"^used some form of rating system (p. 19), In our New Mexico study, 65 of / 
71 districts (9U55%) used some form of rating scale. 

It is also interesting to note that scaling patterns have remained . 
fairly stable. As Table 5 indiqates, two, three, or four point scales 

^ Insert Table 5 about here 

accounted for 58. 68^, of all scales in 1915^ and 73,85% of all scales in 
:1978, What the Table shows is a clear present trend toward reducing the 
number of scale units. Five point scales prevalent in the mid-forties are 
now relatively rare, and two and three point scales alone account for 46*16% > 
of all scales currently in use in New Mexico, The resolution of the problem 
originally posed by Boyce, 1,e., the difficulty in discriminating between 
scale units, appear% to have been resolved by simply reducing the nur^er 
of scale values^^ 
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Ftnally, ws looked at the stated purposis for engaging In teachep, 

evaluation. Here again we have corlie full circle, professor Ell lott . 

(in ioyce, 1915) 1n a "Special Note" which, followed the presentation of 

his "Provisional Plan for the Measure df^ Merit of Teachers," stated 

unambiguously* • . 

It 1s believed that this analytical plan for the study, of 
teaching merit will be of the greatest service If placed 
^ directly in the hands of teachers for their own guidance, 
and as a basis for cooperative effort between teachers and 
super visiors'. The plan is not Intended to Be usetf' a^^^ - • ^ 
score card by inspectors . "Tp. 81 i emphasis in orlgTnal) 

ETTiott's intentions were quickly subverted. Boyci reports the four 
major uses of teachers ratings as "(1) for the private information of the 
Superintendent; (2) for the purpose of furnishing a basis for salary 
adjustment, or to control salary adjustment; (3) for use In connection with 
other* factors, such as length of service, examination, or special work to 
datarmtne promotion I (4) to Impirova the tiachars 1n sarvlca" (p, 23)* 
Raavts and Cooper's (1945) analysis of 85 ratings scalas ylaldfd 16 purposes 
the, top four being (1) for ra-amployment (N - 23; 27*1%)| (2) to change 
teaehing asslgmnent (N ^ 14; 16.S«)| (3) to transfer to a diffarant school 
(N ^ lU 12*9%)^ and (4) to datennlne salary (N ^ 6;7,1«), All other 
catagorlas of purposes Including instructional imporyament, had fraquencias 
of less than five. The major point is that the teacher self -improvement 
advocated by Elliott had literally disappaarad by the mid forties. 
Curiously J however ^ that thrust re-appears In the savantlis. In our 
New Mexico study, the four most commonly listed purppses were: T) to 
Improve the quality of instruction (N « fl);/i> to assist the teacher 



to irnproviliiTiplcp^ie 
tiacher pprfonTianei/ 
in the opening 



at work* Havlnci 



^ in\.1dentlfy1ng ar^as for improvemint (N ^ 6)i 3) 
pirforr^ance (N ^ ancl 4) to measure of evaluate 
effictlventss/compitence .(N " 5). Addltlonallyi 
paragraph of this report we cited the results of the 1978 Educatlinal 
Research Services Study \f/h1ch posited. a similar eirphasls on Improving 
Iteaching performance. 

Agalns Culbert's "organization traps" may be 
become propagandized to the pol^t of believing prihclpalsarfe instiru 
leaders and that the purpose of teacher evaluation! 1s the Improveniprit of 
Instruction we assume those conditions to be true, I Our analyses si^glpest 
rather forcefully that they are not. 

summary 

Initially we proposed that the manifest purpoiel of teacher eva^lluatlon 
as articulated by school districts was to Imprpve instruction but that^the 
latent purpose was to enhance organizational maintenance. From our cW« 
* parative analsis of teacher evaluation Instruments from three points In 
time corresponding roughly to the Age of Efficiency, the Age of Human 
Relations! and the 1970*s we are prepared to talk about the persistence 
of the rhetoric and the reality. The rhetoric of evaluat\l on for Improvi^ 
ment was or 1 g1 nal ly arti cul ated^y 1111 ott , al though perhaps not sel f ^ 
consciously so. It persists, Tha^tality of ttacher avaluBtloh as a " 
mechanism for personnel decision miking a key element In organizational 
raalntenance was established by Boyce* It too persists, as\ strongly or 
more strongly than ever* Together the rhetoric and reality constitute the 
hand of history, the trap, from which few school districts have \been able 
to escape. , 
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Footnotes 



1 



Two cattgories., '|Student Outcoities'' and ''Other'' 
Into the conctpiual sohfme of teachers' roles or role perfonnance. 
Howtver, these categories -accburrt for only 1..76% of the content Items. 



The variahce In the number of Items devoted to the Instructional 
role on the rattng scaVfe Instruments may be of Interest to the reader. 
'"^ " " " ... g teacJier was rated ranged from 6 to 63. 

Item arid one Instrument Included 27 1tems^; 



p 111^ 

Which 
ip one 



The number of Itanis on 

Tv/o Instruments llnclude; _ _ „.„ 

related to the tbacher'b Instructional role. The modarnumber of items 



.wil_ f 1m (aw^ in tlin ini 
"average" Instrument contain^ 
instructional role. 



trumenti ) and the mtdl atuwas siven^ The 
id eight items related to t^e teacKer's 



The sub-category personal traits contained 398 items and thus 
r^resan ted 68.74% of the per,spnal charactirl sties category and 20.64^ 
of the total number of items 1n the rating scale Instruments. Tteitis 
includid under f^ye other sub-categories accounted for the remaining " : 

31.26% of the personal characteristics category i 1) voica/speech (12.61%)* 
2) grooming <8.98%), 3} physical fitness (6.39%), 4) general characteristics/ 
attitudes (2.76%) and 5) the^esidual category "other" (.52%)> 

4' ^ ■ 1 ■ ' ' ^ ^ ^ • V"-"- 

Our data on this point iwas limited since 50 of the 71 instruments ) 

lade no indication of the target of evaluation (tenured vs non-tenured 

:eachers). However, supporting docupntatidn provided by some school 

listricts* e.g., policy manuals, indicated a clear 'distinction In evaluation 

requirements for those two groups. 

i --5 ■ i ^ ' ' - ^ ^■'■•^•^^""^ 

Subsequently we would argue that such "evolution" (if there has 
bain evolution at^ll!) is on a Darwinian scale; 

i An example of a decision rule was to code double headed items, e.g.,/ 

"optimism and enthusiasm," as separate items; This of necessity altered r 
the total N. For Instancei the Elliott Instrument contained 44 items i 

\(ever, by coding' double headed Tttms as single items, the number of items . 
increased to 55, ^ . / J 

^From one to three purposes of teacher evaluati^^^ were listed by 
lach of the, nineteen school districts. >^ 
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